Azure Client Architect with Data Bricks Development Platform Experience

Location: Bangalore (Hybrid)

Job Type: Contract to Hire

Prior Experience

• Hands-on experience working in Azure cloud platform
• Experience in designing and implementing scalable and secure Azure cloud solutions using Data Bricks Client platform
• Understanding of implementation of architecture within Azure Big Data Analytics Al tools
• Expert level in designing and architecting solutions in:
  • Azure Data Factory
  • Azure Databricks
  • Azure Data Lake
  • Delta Lake
  • Azure Synapse Analytics implementation
• Experience in Azure cloud technologies:
  • PySpark
  • Synapse
  • ADF
  • Databricks
  • Python
  • Scala
  • SQL
• Good experience configuring Microservices using Docker, Kubernetes on Azure Data Bricks
• Extensive experience working on Azure AI services including Data Bricks and Azure cognitive services
• Highly preferred experience working with Azure OpenAI services
• Hands-on experience designing and optimizing LLM, natural language processing (NLP) systems, frameworks, and tools
• Hands-on AI/Client modeling experience of complex datasets combined with a strong understanding of the theoretical foundations of AI/Client
• Expertise in most of the following areas:
  • Supervised & unsupervised learning
  • Deep learning
  • Reinforcement learning
  • Federated learning
  • Time series forecasting
  • Bayesian statistics
  • Optimization
• Experience creating and deploying code libraries using functions and classes in Python in AI product-focused development
• Well-versed in software development and code quality best industry practices
• Experience working with Agile Development methodologies

Responsibilities

• Architect, design, and develop AI applications on Azure cloud
• Lead the Azure cloud architecture design for various applications depending on business requirements
• Prototypes and do proof of concepts (PoC) in one or all the following areas:
  • LLM
  • NLP
  • DL (Deep Learning)
  • Client (Machine Learning)
  • Object detection/classification
  • Tracking, etc.
• Stay up to date with the latest advancements in LLM, NLP, deep learning, machine learning, and object detection algorithms, and proactively identify opportunities to leverage new technologies for improved solutions
• Work with a team of researchers and engineers to build state-of-the-art language models that can understand and generate human-like text
• Work with business users to translate functional requirements into data specifications
• Collaborate with data scientists and business users to transform domain know-how into functional requirements

Data Analysis and Preprocessing

• Collect and preprocess large-scale text corpora to train and fine-tune language models
• Conduct data analysis to identify patterns, trends, and insights that can inform model development and improvement

Language Model Development

• Utilize off-the-shelf LLM services, such as Azure OpenAI, to integrate LLM capabilities into applications
• Collaborate with the research team to design and develop state-of-the-art language models

Model Training and Evaluation

• Train and fine-tune language models using appropriate machine-learning frameworks and tools

Research and Innovation

• Stay up to date with the latest advancements in the field of natural language processing and machine learning

Collaboration and Communication

• Collaborate effectively with cross-functional teams, including researchers, DevOps architects/engineers, and project managers
• Communicate complex ideas and technical concepts clearly to stakeholders and team members supported by Large Language Model (LLM) technology

Documentation and Knowledge Sharing

• Document code, algorithms, and processes to ensure effective knowledge transfer and maintain codebase quality

Requirements

• B.E./ B. Tech / M. Tech/ MCA (Computer Science/Electronics & Communication/Electrical)
• Master's in computer science, artificial intelligence, or a related field, or a specialization in natural language processing is preferred
• 4-6 years of IT experience with a minimum of 3+ years in Data Science (AI/Client) with a specialization in NLP and Azure Data Bricks for development and Azure Services
• Strong expertise in Azure cloud solutions
• Strong programming skills in Python
• Experience with deep learning frameworks (e.g., TensorFlow, PyTorch) is highly desirable
• Solid understanding of natural language processing techniques, including language modeling, text classification, sentiment analysis, and machine translation
• Familiarity with statistical and machine learning approaches, such as neural networks, recurrent neural networks (RNN), and transformer models
• Experience with large-scale data processing, including data collection, cleaning, and preprocessing
• Proficiency in working with UNIX/Linux environments and command-line tools
• Strong analytical and problem-solving abilities
• Excellent communication skills, interpersonal, written, visual (presentations), and verbal